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AUTOSTEREOSCOPIC DISPLAY FOR MULTIPLE VIEWERS 
CROSS REFERENCE TO RELATED APPLICATIONS 

Reference is made to commonly-assigned copending U.S. Patent 
Application Serial No. 10/393,236, filed March 20, 2003, entitled METHOD 
5 AND APPARATUS FOR MONOCENTRIC PROJECTION OF AN IMAGE, by 
Joshua M. Cobb and U.S. Patent Application Serial No. 10/465,503, filed June 19, 
2003, entitled METHOD AND APPARATUS FOR FORMING AN IMAGE ON 
A CURVED DIFFUSIVE SURFACE, by Liang et al., the disclosures of which 
are incorporated herein. 
1 0 FIELD OF THE INVENTION 

This invention generally relates to display apparatus and more 
particularly relates to an apparatus and method for autostereoscopic display to 
multiple viewers. 

BACKGROUND OF THE INVENTION 

1 5 The potential value of autostereoscopic display systems is widely 

appreciated particularly in entertainment and simulation fields. Autostereoscopic 
display systems include "immersion" systems, intended to provide a realistic 
viewing experience for an observer by visually surrounding the observer with a 
three-dimensional (3-D) image having a very wide field of view. As 

20 differentiated from the larger group of stereoscopic displays that include it, the 
autostereoscopic display is characterized by the absence of any requirement for a 
wearable item of any type, such as goggles, headgear, or special glasses, for 
example. That is, an autostereoscopic display attempts to provide "natural" 
viewing conditions for an observer. 

25 One example autostereoscopic system is disclosed in commonly- 

assigned U.S. Patent No. 6,416,181 (Kessler et al.), incorporated herein by 
reference, herein referred to as the '181 patent. In an autostereoscopic projection 
apparatus 10 as described in the '181 disclosure and as shown in Figure 1, a 
curved mirror 24 is employed, in combination with a beamsplitter 16 for 

30 providing an autostereoscopic virtual image to a viewer 12 at left and right 
viewing pupils 141 and 14r. For left and right viewing pupil 141 and 14r, a 
corresponding image generation system 701 and 70r provides an initial 
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intermediate curved image that is then projected through a ball lens segment 30 in 
order to form a left or right intermediate curved image 801 or 80r at a focal plane 
of curved mirror 24. 

The substantially monocentric optical apparatus of the '181 
5 disclosure provides realistic autostereoscopic imaging with large viewing pupils, a 
very wide field of view, and minimal aberration. However, one salient limitation 
of the apparatus represented in Figure 1 is its constraint to use by only one viewer 
12 at a time. While this arrangement may be suitable for some types of simulator 
or entertainment applications, there can be applications where it is advantageous, 
1 0 and more cost-effective, to provide autostereoscopic images to a second viewer 
12. 

Autostereoscopic display systems for multiple viewers have been 
proposed, including the following: 

U.S. Patent No. 6,449,090 (Omar et al.) discloses a dual- 
1 5 function apparatus that can be used to provide an 

autostereoscopic image to a single viewer and stereoscopic 
images to multiple viewers, each of whom, however, requires a 
polarizing or shuttering device; and 
European Patent Specification EP 0 602 934 discloses an 
20 autostereoscopic display apparatus that provides a real image 

simultaneously to two observers. One shortcoming of this 
approach for many types of display applications relates to the 
separation of left- and right-eye images; in a disclosed 
embodiment, right- and left-eye images are reversed for the two 
25 observers. 

For fully satisfactory 3-D viewing, an autostereoscopic display 
system should provide separate, high-resolution images to right and left eyes. It 
can also be readily appreciated that such a system is most favorably designed for 
compactness, creating an illusion of depth and width of field, while occupying as 
30 little actual floor space and volume as is possible. For the most realistic viewing 
experience, the observer should be presented with a virtual image, disposed to 
appear a large distance away. Thus, it can be seen that there is a need for an 


autostereoscopic imaging subsystem using pupil imaging that provides virtual 
images for multiple viewers. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to provide an 
autostereoscopic display apparatus that can be viewed by multiple viewers. With 
this object in mind, the present invention provides an autostereoscopic optical 
apparatus for displaying a stereoscopic virtual image to a first viewer and to a 
second viewer, wherein the stereoscopic virtual image is imaged to each viewer at 
a left viewing pupil and a right viewing pupil, the apparatus comprising: 

(a) a left image generation system for forming a curved left 
intermediate image; 

(b) a left projection system comprising a left ball lens segment, 
wherein the pupil of the left ball lens segment is substantially 
concentric with the curved left intermediate image, the left ball 
lens segment forming a real image of the curved left 
intermediate image; 

(c) a first beamsplitter disposed to direct the curved left 
intermediate image toward a focal surface of a first curved 
mirror, the first curved mirror forming a virtual image of the 
curved left intermediate image thereby, and the first curved 
mirror disposed to form: 

(i) through the first beamsplitter, a real image of the pupil 
of the left ball lens segment at the left viewing pupil of the 
first viewer; and 

(ii) through a second beamsplitter, a real image of the pupil 
of the left ball lens segment at the left viewing pupil of the 
second viewer; 

(d) a right image generation system for forming a curved right 
intermediate image; 

(e) a right projection system comprising a right ball lens 
segment, wherein the pupil of the right ball lens segment is 
substantially concentric with the curved right intermediate 
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image, the right ball lens segment forming a real image of the 
curved right intermediate image; 

(f) a third beamsplitter disposed to direct the curved right 
intermediate image toward a focal surface of a second curved 
5 mirror, the second curved mirror forming a virtual image of the 

curved right intermediate image thereby, and the second curved 
mirror disposed to form: 

(i) through the third beamsplitter, a real image of the pupil 
of the right ball lens segment at the right viewing pupil of 

10 the second viewer; and 

(ii) through the second beamsplitter, a real image of the 
pupil of the right ball lens segment at the right viewing 
pupil of the first viewer. 

It is a feature of the present invention that it utilizes light that is 
1 5 otherwise unused for a single-viewer autostereoscopic immersion system. The 
system is essentially monocentric, inherently minimizing image aberrations. 

It is an advantage of the present invention that it provides, from a 
single display apparatus full autostereoscopic viewing for at least two viewers. 

These and other objects, features, and advantages of the present 
20 invention will become apparent to those skilled in the art upon a reading of the 
following detailed description when taken in conjunction with the drawings 
wherein there is shown and described an illustrative embodiment of the invention. 
BRIEF DESCRIPTION OF THE DRAWINGS 
While the specification concludes with claims particularly pointing 
25 out and distinctly claiming the subject matter of the present invention, it is 
believed that the invention will be better understood from the following 
description when taken in conjunction with the accompanying drawings, wherein: 
Figure 1 is a perspective view showing a prior art autostereoscopic 
optical apparatus for display to a single viewer; 
30 Figure 2a is schematic view showing the optical paths for a display 

apparatus serving multiple viewers simultaneously; 
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Figure 2b is a perspective view showing an arrangement of optical 
components corresponding to the schematic view of Figure 2a; 

Figure 3a is schematic view showing the optical paths for another 
embodiment of a display apparatus serving multiple viewers simultaneously, using 
5 a single mirror; 

Figure 3b is a perspective view showing an arrangement of optical 
components corresponding to the schematic view of Figure 3 a; 

Figure 4a is schematic view showing the optical paths for yet 
another single-curved-mirror embodiment of a display apparatus for a display 
1 0 apparatus serving multiple viewers simultaneously; 

Figure 4b is a perspective view showing an arrangement of optical 
components corresponding to the schematic view of Figure 4a; 

Figure 5a is schematic view showing the optical paths for yet 
another alternative display apparatus serving multiple viewers simultaneously; 
1 5 Figure 5b is a perspective view showing an arrangement of optical 

components corresponding to the schematic view of Figure 5 a; 

Figure 6a is schematic view showing the optical paths for yet 
another alternative display apparatus using a single curved mirror to serve 
multiple viewers simultaneously; and 
20 Figure 6b is a perspective view showing an arrangement of optical 

components corresponding to the schematic view of Figure 6a. 

DETAILED DESCRIPTION OF THE INVENTION 
The present description is directed in particular to elements 
forming part of, or cooperating more directly with, apparatus in accordance with 
25 the invention. It is to be understood that elements not specifically shown or 
described may take various forms well known to those skilled in the art. 

The disclosure of U.S. Patent No. 6,416,181 and U.S. Patent 
Application Serial Nos. 10/393,236 and 10/465,503 give detailed information on 
how an intermediate image can be formed using a linear or an area spatial light 
30 modulator. The description of the present invention that follows concerns itself 
with the optical path that, given these left and right intermediate images, forms 
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left and right virtual images in order to provide an apparatus allowing multiple 
viewers. 

Embodiments with Multiple Curved Mirrors 24 

Referring to Figure 2a, there is shown, in side-view schematic 
5 form, an embodiment of a multi-viewer autostereoscopic imaging apparatus 100 
employing a left curved mirror 241 for providing an image to left pupils 141 of 
viewers 12a and 12b. In the optical path for both left pupils 141, a left 
intermediate image 761 is generated from left image generation system 701, as 
shown in Figure 1 and described in the '181 disclosure. Left ball lens segment 301 

10 may be a ball lens component comprising a fully spherical lens or may be an 
hemispheric lens segment having a reflective surface, as is disclosed in 
commonly-assigned U.S. Patent No. 6,511,182 (Agostinelli et al.), incorporated 
herein by reference. Left intermediate image 761 is projected by left ball lens 
segment 301 and reflected from a beamsplitter 16a to the focal surface of left 

15 curved mirror 241 as a real image. The resulting collimated left virtual image is 
then viewed by viewer 12a at left viewing pupil 141. A second beamsplitter 16b 
cooperates with a third beamsplitter 1 6c to direct the collimated left virtual image 
to left viewing pupil 141 of viewer 12b. 

From the schematic view of Figure 2a, the optical path to left 

20 viewing pupil 141 for viewer 12a can be traced through the following points: 
Channel I Pl^ P2-> P4^P2^P1^ Left viewing pupil 141 
The optical path to left viewing pupil 141 for viewer 12b can be traced through the 
following points: 

Channel I ^ Pl^ P2^ P4^P2^P5-> Left viewing pupil 141 

25 The optical path for both right pupils 14r of viewers 12a and 12b begins with right 
intermediate image 76r, employs a curved mirror 24r and beamsplitters 16a, 16b, 
and 16c, and can be similarly traced. From the schematic view of Figure 2a, the 
optical path to right viewing pupil 14r for viewer 12a can be traced through the 
following points: 

30 Channel II^P5^P2-»P3^P2^P1^ Right viewing pupil 14r 

The optical path to right viewing pupil 14r for viewer 12b can be traced through 
the following points: 
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Channel II->P5^P2^P3->P2^P5-> Right viewing pupil 14r 
Referring to Figure 2b, there is shown a perspective view of optical 
components corresponding to the arrangement of Figure 2a. 

A second embodiment using multiple curved mirrors 241 and 24r is 
5 shown in Figures 5a and 5b. In this alternate arrangement, ball lens segments 301 
and 30r are located close together, as is shown most clearly in the perspective 
view of Figure 5b. Only two beamsplitters 16a and 16b are required. A folding 
mirror 82 is used for directing the light path to viewer 12b. 

From the schematic view of Figure 5a, the optical path to left 
10 viewing pupil 141 for viewer 12a can be traced through the following points: 
Channel I -> Pl-> P2-> P3^P2^P1^ Left viewing pupil 141 
The optical path to left viewing pupil 141 for viewer 12b can be traced through the 
following points: 

Channel I -> PI -> P2^ P3^P2^P5^ Left viewing pupil 141 
1 5 From the schematic view of Figure 5a, the optical path to right 

viewing pupil 14r for viewer 12a can be traced through the following points: 
Channel II^P1^P2^P4->P2^P1^ Right viewing pupil 14r 
The optical path to right viewing pupil 14r for viewer 12b can be traced through 
the following points: 

20 Channel II^P1^P2^P4^P2-*P5^ Right viewing pupil 14r 

Embodiments with a Single Curved Mirror 24 

Referring to Figure 3a, there is shown, in side-view schematic 
form, an embodiment of a multi-viewer autostereoscopic imaging apparatus 100 
employing a single curved mirror 24 for providing images at both left and right 

25 pupils 141 and 14r for viewers 12a and 12b. In the optical path for both left pupils 
141, a left intermediate image 761 is generated from left image generation system 
701 (not shown in Figure 3a). Left intermediate image 761 is projected by left ball 
lens segment 301 and reflected from first beamsplitter 16a to second beamsplitter 
1 6b near the focal surface of left curved mirror 241, as a real image. The resulting 

30 collimated left virtual image is then reflected from second beamsplitter 16b and, 
through first beamsplitter 16a can be viewed by viewer 12a at left viewing pupil 
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141. Second beamsplitter 16b also cooperates with third beamsplitter 16c to direct 
the collimated left virtual image to left viewing pupil 141 of viewer 12b. 

From the schematic view of Figure 3a, the optical path to left 
viewing pupil 141 for viewer 12a can be traced through the following points: 
5 Channel I -> Pl-> P2-» P3^P2^P1 ^ Left viewing pupil 141 

The optical path to left viewing pupil 141 for viewer 12b can be traced through the 
following points: 

Channel I ^ Pl^ P2-> P3-^P2^P5^ Left viewing pupil 141 
From the schematic view of Figure 3 a, the optical path to right 
10 viewing pupil 14r for viewer 12a can be traced through the following points: 
Channel II->P5^P2^P3^P2->P1^ Right viewing pupil 14r 
The optical path to right viewing pupil 14r for viewer 12b can be traced through 
the following points: 

Channel II^P5^P2^P3^P2->P5^ Right viewing pupil 14r 
1 5 Referring to Figure 3b, there is shown a perspective view of optical 

components corresponding to the arrangement of Figure 3a. 

Referring to Figures 4a and 4b, there is shown an alternate 
arrangement for multi-viewer autostereoscopic imaging apparatus 100 using one 
curved mirror 24, with folding mirror 82 added. From the schematic view of 
20 Figure 4a, the optical path to left viewing pupil 141 for viewer 12a can be traced 
through the following points: 

Channel I Pl-> P2-> P3^P2->P1^ Left viewing pupil 141 
The optical path to left viewing pupil 141 for viewer 12b can be traced through the 
following points: 

25 Channel I ^ Pl^ P2-» P3^P2^ P4-^P5^ Left viewing pupil 141 

From the schematic view of Figure 4a, the optical path to right 
viewing pupil 14r for viewer 12a can be traced through the following points: 
Channel II^P4-^P2^P3^P2^P1^ Right viewing pupil 14r 
The optical path to right viewing pupil 14r for viewer 12b can be traced through 
30 the following points: 

Channel II->P4^P2^P3->P2^ P4^P5^ Right viewing pupil 14r 
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Yet another embodiment using one curved mirror 24 is shown in 
Figures 6a and 6b. In this alternate arrangement, ball lens segments 301 and 30r 
are located close together, as is shown most clearly in the perspective view of 
Figure 6b. Only two beamsplitters 16a and 16b are required. Folding mirror 82 is 
5 used for directing the imaging light path to viewer 1 2b. 

From the schematic view of Figure 6a, the optical path to left 
viewing pupil 141 for viewer 1 2a can be traced through the following points: 
Channel I -> Pl-> P2^ P4^P2-^P1^ Left viewing pupil 141 
The optical path to left viewing pupil 141 for viewer 12b can be traced through the 
10 following points: 

Channel I -> Pl-> P2^ P3^P2^P5-> Left viewing pupil 141 
From the schematic view of Figure 6a, the optical path to right 
viewing pupil 14r for viewer 12a can be traced through the following points: 
Channel II^Pl^P2^P4^P2^Pl-» Right viewing pupil 14r 
1 5 The optical path to right viewing pupil 14r for viewer 1 2b can be traced through 
the following points: 

Channel II^P1^P2^P4^P2-»P5^ Right viewing pupil 14r 
As is noted hereinabove, embodiments shown in Figures 2b, 3b, 
4b, 5b, and 6b depict ball lens segments 301, 30r as spherical; however, with any 
20 of these configurations, one or both ball lens segments 301, 30r could use a 
hemispheric lens segment having a reflective surface. 
Advantages and Tradeoffs for Embodiments Shown 

The embodiments shown in Figures 2b, 3b, 4b, 5b, and 6b use 
different arrangements of curved mirror 24 and left and right ball lens segment 301 
25 and 30r. It is instructive to note some advantages and drawbacks presented by the 
various design approaches shown in these figures. As advantages, designs using a 
single curved mirror 24, as shown in Figures 3a, 3b, 4a, 4b, 6a, and 6b, use fewer 
components and allow a longer working distance. Among disadvantages where 
using a single curved mirror 24 are off-axis anomalies for forming left and right 
30 viewing pupils 141 and 14r. For each viewer 12, both left and right optical paths 
must be slightly off-axis with respect to curved mirror 24. This causes a slight 
keystoning aberration in each optical path, with keystoning in opposite directions 
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between left and right images. To some extent, this effect can be corrected 
electronically. 

Designs using left and right curved mirrors 241 and 24r, such as 
those shown in Figures 2a, 2b, 5a, and 5b allow on-axis imaging, minimizing or 
5 eliminating keystoning effects. However, designs using multiple mirrors are 
disadvantaged due to mechanical placement constraints; it is difficult to arrange 
both left and right curved mirrors 241 and 24r without some obstruction and 
consequent reduction of field width. 

Another design consideration relates to the relative positioning of 

10 left and right ball lens segments 301 and 30r. In the embodiments of Figures 2b, 
3b, and 4b, both left and right ball lens segments 301 and 3 Or can be separately 
positioned, with a relatively large distance between them. This arrangement eases 
space requirements for imaging support components and allows the size of ball 
lens segment 30 components to be relatively larger, providing a larger viewing 

15 pupil 14. By contrast, the embodiments of Figures 5b and 6b require that ball lens 
segments 301 and 30r be positioned closely together, but allow a more compact 
design overall. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 

20 and modifications can be effected within the scope of the invention as described 
above, and as noted in the appended claims, by a person of ordinary skill in the art 
without departing from the scope of the invention. For example, a number of 
different image generation system 70 configurations could be employed, using 
either scanned linear spatial light modulators or area spatial light modulators. 

25 Examples of scanned linear spatial light modulators include grating light valve 
(GLV) linear arrays, as described in U.S. Patent No. 5,31 1,360 (Bloom et al.) and 
conformal grating electromechanical system (GEMS) components, as disclosed in 
commonly-assigned U.S. Patent No. 6,307,663 (Kowarz). Examples of area 
spatial light modulators include liquid crystal device (LCD) or digital micromirror 

30 device (DMD) components, both well known in the digital imaging arts. 

The curved image formed as left or right intermediate image 761, 
76r could be formed on a diffusive surface, as was described in the '1 81 


disclosure, or could be formed using techniques disclosed in copending 
applications noted above, U.S. Patent Application Serial Nos. 10/393,236 and 
10/465,503. 

Thus, what is provided is an autostereoscopic display apparatus and 
method for providing a virtual image display using pupil imaging to multiple 
viewers. 
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Multi-viewer autostereoscopic imaging apparatus 


